Multiple Contact And/or Sense Promotional Systems and Methods

ABSTRACT

Various embodiments that may generally relate to presentation of content in a coordinated manner through a plurality of output devices is described. A smartphone, for example, may enhance a visual presentation made by a digital billboard by adding audio to the presentation. Various methods are described. Various apparatus are described. Further embodiments are described.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/334,856 filed Jul. 18, 2014, which claims benefit of U.S. ProvisionalApp. No. 61/856,249, filed Jul. 19, 2013, each of which is herebyincorporated by reference herein in their entirety.

U.S. application Ser. No. 11/621,369 entitled “System for managingpromotion”, U.S. application Ser. No. 11/567,322 entitled “Method andapparatus for advertising on a mobile gaming device”, and U.S.application Ser. No. 12/147,005 also entitled “Method and apparatus foradvertising on a mobile gaming device”, and U.S. application Ser. No.12//56,619 entitled “Optical systems and elements with projectionstabilization and interactivity” are all hereby incorporated herein byreference.

FIELD

Some embodiments may generally relate to advertising and/or integrationof multiple output device into a presentation.

BACKGROUND

Display devices, such as billboards, televisions, digital signs, and soon may be viewed by individuals. Mobile devices, such as cellulartelephones, PDAs, notebook computers, smartcars, smart watches, and soon may be proximate to individuals.

SUMMARY

The following should be understood as example embodiments, and not asclaims. A.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1a and 1b illustrate some example systems that may be used in someembodiments

FIG. 2 illustrates an example method that may be performed in someembodiments.

FIG. 3 illustrates an example of an interaction that may be enabled insome embodiments.

FIG. 4 illustrates an example of a data format that may be used in someembodiments.

FIG. 5 illustrates an example of an interaction that may be enabled insome embodiments.

FIG. 6 illustrates an example of an interaction that may be enabled insome embodiments.

FIG. 7 illustrates and example device that may be used in someembodiments.

FIG. 8 illustrates an example method that may be performed in someembodiments.

DETAILED DESCRIPTION I. Example Embodiments

A variety of display elements surround us in many differentenvironments. For example, in Times Square one is surrounded by adazzling array of digital billboards, conventional billboards, computerdisplays, televisions, and so on. Those display elements taken togetheror separately provide an opportunity to display content and/oradvertising to viewers. However, those same elements may have no orlimited ability to reach beyond visual presentations. By combining oneor more display elements with a device capable of providing enhancementsto a visual display, traditional content from such elements may beenhanced. For example, a user's cell phone may be turned into a speakerdevice so that audio from a digital billboard may be heard locally by anobserver. Many other examples of potential interactions, methods, andsystems are described herein.

Some embodiments may include one or more display devices. Such devicesmay act together or separately. Such devices may include digital displaydevices that transmit visual information through an LED, LCD and/orother display technology. One example display device is the digitaldisplay device at Harmon Corner in Las Vegas. In some embodiments,display device components and/or control equipment may be obtained fromPanasonic of Osaka, Japan and/or YESCO of Salt Lake City, Utah. Anotherexample display device is the NASDAQ sign in Times Square. In someembodiments, a display device may include a digital billboard. Such abillboard may have no or limited sound capabilities (e.g., to abide bylocal noise ordinances). In other embodiments, a digital device may havefull and/or robust audio capabilities.

It should be recognized that display devises have been described interms of billboards and/or public space displays, that those examplesare non-limiting. A display device may include for example, a seat backdisplay in a car, airplane, boat, etc.; a television such as in anairport, a gym, a sports bar, etc.; any digital display in any context,a neon sign, any moving display device in any context, any stationarydisplay device in any context; and/or any display device desired. Itshould be further recognized that while display devices have beendescribed in the context of electronic devices, that such examples arenon-limiting. A display device for example may take the form of atraditional billboard, a side of a building turned into a display, awater surface made to move in a pattern, a surface of any type in anycontext whether continuous or non-continuous, whether mobile orstationary that is used to make a presentation, and so on.

It should be recognized that while various display devices have beendescribed, that such devices are given as non-limiting examples only andthat some embodiments may include one or more display devices in anycombination as desired.

A device that enhances a display may include advice remote from adisplay device, such as a portable electronic device. Such a portabledevice may include, for example, a cellular telephone (e.g., asmartphone, an android phone, an iPhone, a windows phone), a laptopcomputer, a smart vehicle, an automobile, a smart watch, wearableelectronics (e.g., google glass), and so on. Enhancement devices mayinclude devices that may have the ability to provide one or more sensoryoutputs. For example, an enhancement device may be able to play audio(e.g., through a speaker phone element of a smartphone, throughheadphones attached to a cell phone, through stereo speakers in a car,etc.), an enhancement device may be able to provide haptic feedback(e.g., a vibration feature of a mobile phone, a vibration or tighteningfeature of a smartwatch, a pinching or shock feature of a wearabledevice, etc.), an enhancement device may be able to provide a visual(e.g., using an augmented reality overlay of a glasses devices, using adisplay element of a portable device, using a projector element of anelectronic device, etc.), an enhancement device may be able to providetaste or smell feedback (e.g., via a digital taste interface, via adigital scent technology, etc.), and so on in any combination.

It should be recognized that while examples of devices are given, thatthose examples are non-limiting and that some embodiments may includeany desired one or more enhancement devices in any combination.

By combining the functionality of one or more display devices and one ormore enhancement devices, content may be presented in a more robustmanner. For example, a speaker in a phone may provide the audio for atelevision in a public space, a haptic device in a wristband may providea vibration for a display on a digital billboard, and so on. Anycombination of display devices and enhancement devices may be used tocreate a combined presentation of content as desired. Various examplesof such presentations and related systems and/or methods are providedherein.

It should be recognized that while examples are given in terms of anenhancement device adding to a display device's presentation that suchexamples are given as non-limiting examples. For examples, in someembodiments, instead of a display device, an audio device (e.g., aspeaker) and a haptic device (e.g., a vibrating floor) may be enhancedwith a display feature on a mobile device. As another example, in someembodiments, a scent device (e.g., a scent emitting device) may beenhanced with a visual feature of an augmented reality glasses device, ahaptic feature of a smart watch and an audio feature of a smartphone.

It should be recognized that one or more enhancement device and/or oneor more primary presentation device may work together in anycombination. Such combinations may be duplicative (e.g., a videoenhancement of a video primary). Such combinations may require allelements or may allow fewer than all elements to operate (e.g., if acustomer does not have or desire haptic, then haptic may not be used butother features may be used).

The Kanye West Paradigm

In 2013, Kanye West released an album using a viral marketing campaign.In a variety of locations, Kanye's face was displayed (e.g., onbillboards and/or building sides). Speakers nearby played music from thealbum in proximity to the display of his face. This marketing campaign,while it was innovative and took advantage of the then currenttechnology, caused a disturbance by violating local noise ordinances.Many presentations were shut down shortly after starting. Moreover,these presentations did not capitalize on the vast data capturepotential related to a content presentation. Some embodiments mayovercome one or more of these drawbacks of this Kanye West marketingcampaign.

For example, in some embodiments, smartphones may be used as audiodevices to present the audio portion of this presentation. Normal earaudio and/or speaker audio may be used depending on user andpresentation preference. For example, to comply with a noise ordinance,to reduce interference issues and/or syncing demands, and/or to maintainprivacy, ear audio element may be used. As another example, to maximizedispersion, to attract others, and/or to create a louder experience, aspeaker element may be used.

A mobile device may cause an audio presentation that accompanies theKanye presentation to be played through such a desired audio element. Avariety of systems and/or methods that may be used to perform such apresentation are described herein.

As one example, a website may be established. A source of audio may beestablished (e.g., a data source on a server). Users may access thewebsite from mobile devices. To make access to the website seamless andeasy, a user may use near field communication to pull the website up ona device. For example, one or more NFC emitters may be placed near aKanye presentation. When NFC enabled devices are put near such anemitter, the devices may be caused to visit the website. The website mayinclude an element (e.g., a java element or other media enabled element)that causes the mobile device to play a make a desired audiopresentation in connection with the visual Kanye presentation. Forexample, an audio player may stream content from the audio data sourcethrough the website (e.g., in response to accessing the website, inresponse to a user actuating a play control through a web interface) tomake the device present an audio presentation. The content may bestreamed from a source so that presentations are made at the same timeor nearly the same time as one another (e.g., to cause a coordinatedlaunch event to occur with the release of a single from the album).

An NFC emitter device may also cause data about devices that communicatetherewith to be recorded. The website may also record information aboutdevices that access the website. A website may query a user forinformation in order to enable an audio presentation and/or after theaudio presentation is made. By collecting such information a user'spreferences may be tracked and used for advertising and/or otherpurposes.

As another example, an application may run on one or more smartphones(e.g., a native app). The application may control the phone to make anaudio presentation in response to one or more inputs. For example, inresponse to a location and/or time, in response to a NFC input, inresponse to a QR code read, and so on a device may be caused to make anaudio presentation to enhance the Kanye visual display. Rather thanrelying upon a user to access a website, an application may cause and/orallow a smartphone to access such an enhanced presentation without needto access the World Wide Web and/or obtain a universal resource locator.For example, a user may be presented with an interface of an applicationthrough which the user may select available enhancements at a given timeand/or location (e.g., near a Kanye display at a time of a Kanyerelease, the user may be presented with the Kanye audio track to play).As another example, a user may access an NFC signal or QR code and theapplication may in response cause the audio presentation to bepresented.

Such an application may report access by a user to an enhancedpresentation. Such an application may report when a user had access butdid not choose to access an enhanced presentation. Such reports may beused to track a user for advertising and/or other purposes.

It should be recognized that while some examples of improving the KanyeWest marketing campaign are given, that such examples are non-limitingexamples only. Such examples illustrate some example functionality thatmay be present in some embodiments, and functionality of one example maybe used in others. For example, a website may be location locked similarto a native application. Examples of methods and/or systems that may beused in some embodiments (e.g., to facilitate described functionality)are described herein.

The Harmon Corner

An intersection in Las Vegas known as Harmon corner where Las VegasBoulevard interests with Harmon Boulevard is home to a digitalbillboard. In some embodiments, this display device at Harmon Corner mayact as a primary display for video output in a presentation. In someembodiments, audio or any other enhancement may be added to thepresentation through the use of, for example, a smartphone.

FIGS. 1a and 1b illustrate example systems that may be used in someembodiments to enable the Harmon Corner enhanced experience or a similarexperience in any of a variety of context (e.g., the Kanye West Paradigmand/or other examples described herein). As illustrated, such a systemmay include a data source 101, a content player 103, a display device105, a server 107, an access point 109, an enhancement device 111,and/or an enhancement player 104.

Various components may communicate with one another in any manner. Forexamples, some components may use a public network such as the Internetand/or a cellular network to communicate, some components may use adedicated networks such as a Local Area Network to communicate. Anycombination or arrangement of communication connections may be used invarious embodiments. For example, as illustrated in FIG. 1a , the datasource 101, content player 103, server 107, and access point 109 maycommunicate using the Internet; content player 103 and display device105 may communicate using a LAN and/or data bus, and access point 109and enhancement device 111 may communicate using a 4G cellular network.

It should be recognized that the examples of FIGS. 1a and 1b are givenas non-limiting examples only. Other embodiments may include anyarrangement and/or combination of devices. For example, as describedelsewhere other embodiments may include other types of primary devicesother than display devices, may include multiple primary devices such asmultiple displays, may include other types of enhancement devices with avariety of output types, may include multiple enhancement devices, mayinclude multiple data sources or other components, may include differenttypes of access points for different data, and so on.

Data source 101 may include a computing device. Such a device enable anoperator of a presentation system to control the operation of thesystem. For example, such a device may enable an operator to schedulewhen presentations are to be made, select presentations, control theoutput of presentations, adjust the relative timing of presentations orpresentation parts (e.g., audio vs. visual), and so on. Such a computingdevice may receive input from an operator and/or control devicedirecting the scheduling and/or play of one or more presentations. Sucha computing device may receive content for the presentations (e.g.,video data, audio data, haptic output data, etc.). The data may berecorded data such as video files in digital form and/or live data, suchas a stream of data from an outside source such as a television feed.Such a computing device may receive input directing how such content isto be presented (e.g., input identifying that video data is to bepresented through display device 105 and that audio data is to bepresented with a 1 ms delay through one or more enhancement devices111). Such a computing device may provide an interface through which anoperator may include commands and data to make a presentation.

Data source 101 may transmit data to content player 103 and server 107(and in some embodiments, enhancement player 104). For example, videodata may be transmitted to content player 103 and audio data may betransmitted to server 107. The data may be transmitted in response tobeing received such as a live television stream comes in. The data maybe transmitted in advance of being played such as if an entire file istransmitted prior to being played. The transmitted data may indicate howand/or when to present the data. For example, the video data transmittedto the content player may indicate that the presentation should bestarted at a certain time. Similarly, audio data transmitted to theserver may indicate that the audio presentation should be started at acertain time. The times may be different (e.g., to account for latencyand/or because a difference is desired for presentation purposes) and/orthe same. For each desired presentation that includes use of theenhancement services and primary display, such a transmission may bemade.

Data source 101 may receive data as a single source of data (e.g., asingle file or single stream). Data source may process the data to splitthe audio and video from the data. Data source may process the data tointroduce any desired delay or offset. Data source may direct the datato the appropriate destination to make the presentation (e.g., streamingand/or in whole). Data source may direct the destinations on how topresent the data (e.g., at what time).

Content player 103 may include a computing device. Such a computingdevice may be configured to receive media data and control a displaydevice to present the media data. A variety of media players are knownin the art. Some example media players may be obtained from YESCO orPanasonic. Content player 103 may receive video data from data source101. In response to receiving the data, content player may controldisplay device 105 to display the data (e.g., by transmitting electroniccontrol signals to the display device). In some embodiments, the datareceived from the data source may identify a time for presentationand/or any other characteristics for presentation. The content playermay play the content in accordance with such instructions (e.g., byplaying the content at a specified time).

Display device 105 may include a digital billboard and/or any otherdisplay device and/or primary output device. In some embodiments, such adigital billboard may include the Harmon Corner billboard. Such abillboard may be designed by YESCO or Panasonic. Such a display devicemay be configured to receive control signals from content player 103 anddisplay a presentation in response. For example, such data may bereceived through a data bus or LAN connecting the display device to thecontent player. Such signals may identify what to output at each of aplurality of pixel locations on the display device to make up apresentation. The signals may change over time to cause a display tochange (e.g., to make a moving display such as a video presentation).

Server 107 may include a computing device with a data storage component.For example, such a device may include a streaming content server,webserver, and/or cloud storage device. Some examples devices that maybe used, may be available through Rack Space of San Antonio, Tex.,and/or Go Daddy of Scottsdale, Ariz. Such a device may be configured toreceive data from the data source (or in other embodiments theenhancement player 104). In response to receiving such data, the servermay present the data through one or more enhancement devices 111. Theserver may receive the data in advance of a presentation (e.g., forrecorded content) and/or receive a stream of data (e.g., for livecontent). The server may forward and/or otherwise allow the enhancementdevices to obtain access to the data in an appropriate format. Theserver may reformat the data to a format that is appropriate for anenhancement device attempting to access the data.

In some embodiments, the server may act as a webserver that responds tohttp requests for access to data (e.g., streaming data, a website,etc.). In response to a web browser or web app accessing the server(e.g., using a URL), the server may provide the data in accordance withinstructions received form the data source (e.g., to present what partof the data at what time). For example, the server may present adesignated portion of the data through web browsers on a plurality ofenhancement devices at a designated time. The server may stream the datato the devices in accordance with a presentation plan so that the audiooutput and video output act together.

In some embodiments, the server may act as a source of data for anenhancement device running an application. The application and servermay act in a client/server relationship to stream or otherwise providedata from the server to the client enhancement device. In someembodiments, the client enhancement device may have control over thepresentation (e.g., the client may receive the data and decide when topresent it) and the server may identify to the client how (e.g., when)to make the presentation. In some embodiments, the server may controlthe client enhancement device to make the presentation without controlby the client (e.g., a direct streaming of data). In some embodiments,the client and server may act together to determine how to present thepresentation. For example, the client may report latency and/or locationinformation and the server may use that to adjust how the presentationis streamed for the specific client enhancement device (or whether it iseven available for location locked presentations).

It should be recognized that the examples of a server and itsrelationship with a client are given as non-limiting examples only. Anyarrangement and combination of responsibilities and/or interactionsbetween a client and a server whether a webserver or otherwise and/orwhether a web browser client or otherwise may be used in variousembodiments.

Access point 109 may include a wired and/or wireless access point forcommunication. For example, in the illustration of Figure la, the accesspoint may be a cell tower. However, the access point may include anydevice that allows an enhancement device to communicate to receivepresentation data (e.g., to communicate with server 107). For example,such a device may include a wireless router, a Bluetooth transmitter, awired router, and/or any communication network access point throughwhich data may be communicated to one or more enhancement devices.Multiple access points may be used in some embodiments (e.g., multiplecell towers, a cell tower and a Wi-Fi router, and so on in anycombination for one or more enhancement devices attached in anyarrangement to such access points).

Enhancement device 111 may include a device capable of providing thedesired enhancement to a primary device. For example, in the illustratedexample of FIG. 1a such a device may include a smartphone that providesaudio enhancement to display device 105. The enhancement device mayreceive audio (or other enhancement) data from server 107 and inresponse present that data to a user to make a enhance presentation withdisplay device 105.

In some embodiments, device 111 may operate a web browser. The webbrowser may be directed at a URL of the server 107 and may requestaccess to a stream of the data. The browser may receive that stream andpresent the audio in that stream to the user. The user may access theweb browser and information on the website through an interface of theenhancement device.

In some embodiments, device 111 may operate an application (e.g., anative app). The application may communicate with the server and controlthe device to enable proper presentation of data. For example, theapplication may request data from the server, receive the data, andpresent the data to the user to enhance the display device. Datareceived may identify information about how to present the data (e.g.,when, through which output, etc.) and the application may control thedevice to present the data accordingly. The application may provide datato the server such as location, time, latency, and so on that may beused to enable and/or adjust the presentation.

In some embodiments, device 111 may include an NFC component that mayallow input form an outside NFC device (e.g., a card with an NFC chip).Interaction with the NFC component may enable access to the serverand/or access to the data through the server. For example, an NFC inputmay control he web browser to direct to the URL of the server. Asanother example, the NFC may communicate a key code/password to anapplication that unlocks the data when presented form the application tothe server. In some embodiments, only devices that have the URL and/orthe key may be allowed to access the data. Other types of input may alsobe included, such as Wi-Fi, Bluetooth, camera, etc. and may be similarlyused to enable a connection to the server.

It should be recognized that the examples of enhancement devices andinteractions with the server are given as non-limiting examples only.Other devices may take any form and include any desired functionalitythat may enable an enhancement to a primary device. Moreover, it shouldbe recognized that while a single enhancement device is shown, that anynumber of enhancement devices may output enhancements for a displaydevice. For example, any viewers of a Harmon Corner display may accessthe enhancement for that display through their smartphones. Theenhancement outputs may be the same or different (e.g., differentlytimed, different content) through different devices. The devices may bedifferent or same types of devices (e.g., android phones and iPhones oronly iPhones).

In the alternative embodiment of FIG. 1b , enhancement player 104 isshown as a component of and/or proximate to the content player 103. Thecontent player and/or enhancement player may receive both primary andenhancement data form a data source in such an arrangement. The contentplayer and/or enhancement player may separate enhancement content formprimary content and may push the enhancement content to the server. Insuch an arrangement, the data source may not be responsible forseparating and/or redirecting the enhancement content, but rather thecontent player and/or enhancement player may have such responsibility.The server may receive enhancement content from the enhancement playerrather than the data source in such an arrangement.

Keeping such content decisions close to the content player and/ordisplay device may work best if the player is more than a dumb terminaland has scheduling responsibilities and/or input from multiple datasources. In such arrangements, keeping the content splitting functionslocal may enable a verification that the contents do not becomedisjointed. On the other hand, the arrangement of FIG. 1a may haveadvantages as well in that it may allow a dumb terminal control of thedisplay device and/or more centralized control of the enhancementservices that may provide lower latency.

The descriptions of the example components and the entirety of thefigures are given as non-limiting examples. Other components andarrangements with other functionality may be used in various embodimentsas desired. For example, in some embodiments, a sever and data sourcemay be a same component, a server and content player may be a samecomponent, a data source and content player may be a same component, andso on. As another example, in some embodiments, a location service maybe included that reports enhancement device location to a server so thatthe server may lock, unlock and/or adjust a presentation based on thelocation. Such allocation serve may include a GPS service (e.g., of aphone reporting to the server), a triangulation service, a geofencingservice, and so on. As yet another example, some embodiments may includean access point restricting element that unlocks content in response tothe content being requested through a particular one or more accesspoints. In such an embodiment, a local Wi-Fi network may be establishednear a display device and based on access through that Wi-Fi network,one or more enhancement devices may be given access to an enhancementoutput. In some embodiments, only those devices may be given access. Anapplication running on an enhancement device may cause the device toautomatically connect to such a network if it is available.

Moreover, even though some embodiments are described as including asingle presentation, other embodiments may include making any number ofpresentations through any number of devices. For example, multiplesimilar presentations may be made at a variety of locations usingprimary and enhancement devices proximate to those locations (e.g.,simultaneously, at different times). In some embodiment, differentpresentations may be made at different locations. In some embodiments aplurality of presentations may be made in a single location (e.g.,according to a schedule, sequentially, simultaneously). A single ormultiple data sources may drive such plurality of presentations asdesired.

FIG. 2 illustrates an example method that may be performed in someembodiments. The method of FIG. 2 may be used, for example, tofacilitate a user at the Harmon Corner to enhance a video playing on theHarmon Corner billboard with an audio stream through a smartphone. Themethod may include use of an NFC device to instruct the smartphone toaccess a data stream for the audio. The method may include a coordinatedaudio and video control from a source of presentation data.

As indicated at 201, some embodiments may include receiving data totransmit through an NFC interaction with mobile devices. For example, anNFC transmitter may be programmed to transmit data indicating a sourceof audio data (e.g., a URL of a server), and/or some information thatmay enable the playing of audio data (e.g., a key to access the data, alink to an application to install to access the data, etc.). Suchinformation may be stored so that it may be transmitted to one or moreNFC enabled devices that enter an NFC field. This access data may definean access parameter for one more user to gain access to a portion of apresentation (e.g., by accessing an identified server, by logging inwith an access code to a resource, by unencrypting a file with anencryption key, etc.).

As indicated at 203, some embodiments may include receiving data topresent to one or more users. The data may include video data to presentthrough a display device and audio data to present through a smartphone. The data may include a data stream such as of alive event and/ora data file such as of a recorded event. Such data may be received froma controller (e.g., a person and/or device controlling a data source).This received presentation data may be defined by audio data, videodata, haptic data, and/or any other type of presentation data. Suchpresentation data may match a location with an output desired (e.g., adifferent audio presentation based on a location of a device making thepresentation).

As indicated at 205, some embodiments may include processing the data toseparate and/or arrange the audio and video to be transmitted toseparate destinations. For example, a computer algorithm may process thedata to remove audio data from a data stream and direct that audio datato a server. The computer algorithm may direct the remaining video datafrom the data stream to the content player. In some embodiments, dataaudio and video data my come to a data source separated so that suchdata may not apply such separating processing. In some embodiments, aserver and/or content player may accept unseparated data so a datasource may not perform such separating processing. Processingpresentation data may include separating audio and video data.Processing presentation data may include preparing (e.g., formatting,addressing, etc.) audio and video data for presentation through separatedestinations. Processing presentation data may include inputting timingdata to audio data so that audio and video data may be synchronized in apresentation. Processing presentation data may include inputtingscheduling information so that a presentation e.g., of a video data) maybe made at a desired time.

In some embodiments, an indication regarding a matching between an audioand video data may be received. Such an indication may identify amatchup between an audio stream and a video stream that are received bythe data source. Such an indication may identify an adjustment to anaudio stream relative to a video stream that are received together. Adata source may adjust an audio and/or video stream in accordance withsuch information (e.g., delay an audio stream, delay a video stream inaccordance with such an indication). In other embodiments, a data sourcemay indicate to a destination that the adjustment should be made there.

As indicated at 207, some embodiments may include transmitting videodata for presentation to a content player and/or display device. Forexample, the data source may transmit a video stream to the contentplayer that may drive the display to present the video data on theHarmon Corner billboard. The data transmitted may indicate a time tostart a presentation. The data may be streamed for immediatepresentation and/or data that is recorded for later presentation at anindicated time. Video data may be transmitted to a publically viewabledisplay device such as a billboard. Such transmission may be made to acontent controller that controls the content displayed on the device.

In some embodiments, a content player may receive video data forpresentation and in response may drive a display device to present avideo presentation embodied in the data. For example, the content playermay receive a video stream from the data source and cause the video tobe presented on the Harmon corner billboard. In some embodiments, anindication of when to begin a presentation may be received and the videodata may be presented at an indicated time. In some embodiments, thevideo may be streamed from a data source. A content player may introducesome latency into a stream of video that may be accounted for, forexample by adjusting a streaming rate or start time between the audioand video streams such as by introducing an offset like the onediscussed with respect to 205 and/or in a manner as described herein orotherwise.

As indicated at 209, some embodiments may include transmitting data foraudio presentation through an enhancement device. For example, the datasource may transmit an audio stream to the server that may enablepresentation of the audio through smartphones that access the server.The data may indicate the time to start a presentation and/or any othercharacteristics of the presentation (e.g., length, speed, locationlimitation, etc.). The data may be streamed for immediate presentationand/or data that is recorded for later presentation at an indicatedtime.

In some embodiments, a server may receive audio data for presentationand in response may enable a smartphone to present the audiopresentation embodied in the data to coincide with the videopresentation. For example, the server may receive an audio stream fromthe data source and cause the audio to be transmitted to one or moresmartphones that communicate with the server. In some embodiments, anindication of when to begin a presentation may be received and the audiodata may be presented at an indicated time. If a user access the serverat a later time, the user may be presented with data that is offset fromthe start time based on the access time (e.g., if the user access theserver 1 minute after the audio was to be started, the user may bepresented with audio from 1 minute later than the start). In someembodiment an audio may be stream from a data source. A server mayintroduce some latency into a stream of audio that may be accounted for,for example by adjusting a streaming rate or start time between theaudio and video streams such as by introducing an offset like the onediscussed with respect to 205 and/or in a manner as described herein orotherwise. In some embodiments, a data source may determine respectivelatencies between audio and video outputs and adjust streamingaccordingly.

Elements 203 to 209 may have been described with respect to the examplefigure la. However, similar elements may occur in an embodiment of FIG.1b and/or other embodiments. For example, a content player and/orenhancement player may receive data from a data source and process it tointroduce any needed delay. The enhancement player may transmit audiodata extracted from data received from the data source to the server.

As indicated at 211, some embodiments may include engaging in a nearfield communication exchange or other communication exchange thatprovides access information to a mobile device (e.g., directs asmartphone to connect to the server). In some embodiments, an NFCtransmitter and a NFC enabled smartphone may come into proximity andengage in an NFC session. The transmitter may transmit an indication ofinformation that may enable the playing of audio data to the smartphone.The smart phone may receive that information and in response communicatewith the server to enable playing of the audio. For example, in someembodiments, the smartphone may receive a URL of the server that the NFCtransmitter transmitted through the NFC session, and in response toreceiving the URL the smartphone may direct a web browser to access theserver (e.g., a webpage hosted at the server, a webpage that has contenthosted at the server). In another example embodiment, the informationmay include a key that an application may use to unlock the ability toplay the audio.

As indicated at 213, some embodiments may include, in response toconnecting to the server, presenting the audio from the server throughthe smartphone to coincide with the video. For example, the smartphonemay stream the audio from the server and play it through a speaker sothat the audio coincides with a video presentation made at the displaydevice (e.g., the Harmon Corner billboard). In some embodiments, a userof the smartphone may be asked to take one or more actions prior to sucha presentation. For example, a user may be asked to actuate a control(e.g., press a play button in an interface), install an application,accept an agreement, enter information (e.g., identifying informationthat may be used for marketing or other purposes), and so on. Inresponse to performing such action and connecting to the server, theaudio presentation may be made. Some embodiments may use a Real TimeStreaming Protocol and/or a Real Time Transport Control Protocol tostream content. It should be recognized that this is a non-limitingexample of a manner of facilitating output of a presentation through adisplaying of the video data by the publically viewable display deviceand a playing of the audio data by the mobile devices. A variety ofexamples of such facilitating of a presentation are given herein.

By performing such an example method of FIG. 2, a video presentationthrough a display device may be enhanced with audio presented through asmartphone. It should be recognized that this method is given as anexample only and that other embodiment may include different, fewer,more, defiantly ordered, similar, and/or no elements similar to thosedescribed. Some embodiments, for example may only include actions takenby a data source. As another example, some embodiments may include alocation and/or Wi-Fi locking functionality. As yet another example,some embodiments may include a QR code or URL that may indicateinformation enabling access to the server instead of a NFC device. Asstill a further example, so embodiments may include one or more syncingfunctionalities.

FIG. 3 illustrates an example of this method as it might appear inaction at the Harmon Corner.

Syncing

Latency and/or other issues may affect how unified a presentation ofvideo and audio from different sources appears. There may be at leasttwo types of syncing that could be a concern in some embodiments. First,a video presentation and an audio presentation may come out of sync withone another so that the audio is not presented at an appropriate time tomatch the video (e.g., a voice is presented before or after a speaker isshown to talk). Viewers of such a presentation may be annoyed by thisdisjointed audio and video and content providers (e.g., advertisers) maynot want to use a technology that annoys their potential customers.Second, audio presentations may come out of sync with one another (e.g.,two smartphones may not present a same audio at a same time). This typeof syncing issue may turn a set of speaker phones that might together bepresenting a coherent presentation into a set of speaker phones thatinstead appear to be outputting noise that is not comprehensible. Thismay not make for a good experience for customers either. Someembodiments may include one or more features to overcome a potentialsyncing issue such as one of these two types of syncing.

The telecommunications industry has spent a significant amount ofresources on eliminating what is known as mouth to ear delay in calls.Some embodiments, in order to reduce latency issues may utilize thiswork. For example, instead of accessing a source of enhancement datathrough the Internet, a device may access the source through a telephoneconnection. For example, in response to a NFC interaction, a smartphonemay be controlled to call a phone number. The phone number may accessthe source of audio (e.g., an audio stream may be presented as a normalcall audio would be presented through the phone). The source of audiomay include an automated call center that connects calls to a recordingand/or audio stream. An application on a smartphone may mask theoutgoing call by presenting a graphic over a typical call screen. Thiscall based solution to latency may not solve all latency issues and mayintroduce some user concerns (e.g., using minutes, making it moredifficult to access incoming calls).

As another example solution that may be combined with any other solutiondescribed herein, some embodiments may include offsetting portions of apresentation. For example, a video portion may be transmitted forpresentation after a corresponding audio portion. A server may determinea latency level between a smartphone and the server and cause the audioto be presented to account for that latency. For example, if a phone andserver have a 20 ms delay compared to a display device, then the servermay present audio to the phone 20 ms in advance of the videopresentation. A server may determine that latency by, for examplepinging a phone, inspecting packets from the phone, and/or any method oflatency determination.

In some embodiments, an average latency over some period of time may beused. In some embodiments, a latency may change and a presentation maychange accordingly. For example, latency may increase and an audioportion may be advanced accordingly (e.g., a portion may be sped up sothat the audio is presented further in advance of the video, a portionmay be skipped so that the audio is presented further in advance of thevideo). An ongoing monitoring of latency may be used so that as latencychanges, the audio presentation may be adjusted. This type of offsettingmay be combined with a calling embodiment. In a call, latency typicallyis more stable and so a single offsetting may be used more reliably.

In some embodiments, a portion of an enhancement presentation and/orprimary presentation may be preloaded to a device in advance of thepresentation. For example, audio data may be cached to a smartphone inadvance of a time when the audio is to be presented. By preloading thataudio data, latency issues with respect to data transmission may beeliminated as an issue that may affect syncing. A smartphone may playthe content at an identified time and/or starting at an identified point(e.g., identified by the server). Such caching may be an effectivemethod of eliminating network latency issues for recorded events.

A caching solution may have limitations when live events are presented(e.g., because there may not be cacheable data to transmit as the eventhas not yet occurred) and/or when the enhancement device itselfintroduces latency (e.g., in processing the data for presentation).

In some embodiments to overcome the lack of cacheability, an entirepresentation may be delayed to allow caching to occur. For example,transmission of video and/or audio data that for a live presentation maybe delayed (e.g., by a data source) so that the presentation is actuallynot live. A delay may be sufficient to provide a reliable amount ofcaching to remote devices. Such a delay, for example may include 200 ms,10 ms, 1 second, 10 seconds, 1 minute, 10 minutes, 1 hour, and/or anyother desired time to allow sufficient caching to reduce latency issues.In response to delaying the sufficient amount time, transmission of thedata form the data source to the appropriate destination may be made(e.g., with/without an offset).

In some embodiments an input element of an enhancement device maymeasure output of the device to determine output latency. While someexamples may have addressed transmission latency, a device itself mayintroduce latency in the presentation of data. As an example, amicrophone of a smartphone may record audio presented by the smartphone.That audio may be time stamped and transmitted to a server. Thetimestamp and audio output may be compared to a desired output at thattime to determine a latency of a presentation. Transmission of data maybe offset to account for that measured latency. Such a measuring oflatency may take place one an ongoing basis, as a calibration stepbefore a presentation, and/or in any other manner.

As another example of a syncing technique that may be used in someembodiments, a Bluetooth and/or other local network technology may beused to coordinate presentations with nearby devices. For example, onesmartphone may detect smartphones that are within Bluetooth range. Thatrange may be used as a proxy for audible range. The device maycoordinate presentation with those nearby devices. An application thatpresents the audio may be configured to allow such coordination to occurthrough a Bluetooth connection.

In some embodiments, one phone may act as a master of other phones anddirect those phones on how to present data. For example, the masterphone may indicate to the other phones that they should start presentingbytes X of the data stream at time Y. The other devices may beresponsible for ensuring proper latency is accounted for (e.g., bymaking a microphone check of latency to audio output). The master devicemay be chosen in any manner (e.g., randomly, first come first serve).Each device may be part of multiple Bluetooth device swarms that may ormay not overlap with one another. Each device may act as master andslave in various contexts. A device acting as master in swarm A andslave in swarm B may pass on its instructions from swarm B to swarm A.

It should be recognized that this example of a swamp of devices actingcooperatively to present a unified audio presentation is given as anon-limiting example only and that any manner of device coordination maybe used if desired.

In some embodiments, data transmitted to an output device may beformatted in a transmission protocol that includes presentationinformation. An output device may be configured to interpret the dataand presentation information so that a presentation of the data is madein accordance with the presentation information. The presentationinformation may include, for example, a time at which the data should bepresented. By including such information with the transmitted data, atransmission source may control an output device to reduce an issue oflatency that may be present in traditional streaming methods. FIG. 4illustrates an example format of data that may be used to facilitatesuch an interaction. Such a format may represent a format for anapplication layer protocol.

The packet may include a payload of audio data indicate at 401. In someembodiments, the payload may be of variable length. In some embodiments,the payload may be of fixed length. The payload may include audio datafor a part of the presentation. An entire audio presentation may bebroken into sequential chunks and placed into such packets that aretransmitted to an output device (e.g., by a server, by a data source,etc.).

The packet may include a start time indicator 403. The start timeindicator may identify a time at which an output of the audio data is tobegin. The start time indicator may be of fixed and/or variable length.The start time indicator may be as specific as desired (e.g., to themillisecond, to the second, etc.). Each segment of audio data may havean associated start time indicator. A data packet may include both theaudio data and its corresponding start time indicator. A source of thispacket (e.g., a data source, a server, a content player, etc.) maydetermine the start time for the audio data and form the packet bycombining these elements.

A start time may be determined based on instructions for scheduling apresentation (e.g., from a controller of a presentation). For example,if a data source is instructed to begin a presentation at 1 pm exactly,then a first packet may identify 1 pm exactly. A first packet maycontain audio data for 10 milliseconds so a second packet may identify 1pm and ten milliseconds as a start time indicator. A time may indicate adate and/or may be interpreted to be the current date and/or otherwisemay include information so that a date may be inferred. It should berecognized that 10 milliseconds is given as an example only and that adata packet may include any desired amount of data according to thespecifics of a protocol. More data may allow for fewer transmissions butmake loss more tragic and less data may eliminate fear of loss but mayrequire a larger processing and transmission rates.

Some embodiments may include any number of presentation descriptors.These descriptors may be optional and/or mandatory for a streamingprotocol. An example is given in a dashed area indicated by 405 thatshows an indicator for a length of time it should take to play the audioportion in the payload. For example, the audio data may be indicated tostart at 1 pm and ten milliseconds and last for 10 millisecond of time.A source of such a packet may determine the length of time for eachpayload of data and include in the packet the length of timeinformation. For example, a data source may determine by processing asource file or stream to match an original length of time in the file orstream.

Some embodiments of such a protocol may not include such a length ofplay descriptor. In such embodiments, an agreed upon formatting of dataand/or length of time per packet may be used. That formatting (e.g.,encoding) of data and/or agreed upon length of time may be used by thereceiving device to identify how long it should take to play the data inthe payload.

A variety of other descriptors may be used in some versions of thisprotocol. The descriptors may be options and/or mandatory in thoseversions of the protocol. For example, some embodiments may include adescriptor of a volume level, a descriptor of an output type (e.g.,speaker phone vs handset speaker), a descriptor of whether a locationcheck should be made to enable play, and/or any other descriptor thatmay describe how a presentation should be made. One or more headerfields that may be optional and/or mandatory may be included in someembodiments. For example, some embodiments may include a data lengthindicator, checksum data, a source identifier, a session identifier, adestination identifier, an identifier of a time source, and/or any otherheader content desired. A source of such a packet may determine thecontents of the fields of the packet in accordance with a desired outputand desired interaction with an output device.

An output device such as a smartphone may receive the data packet andcause the audio data to be presented in accordance with the presentationdescriptors. For example, an application running on the smartphonewhether it be a web browser, a plugin for a browser, a nativeapplication designed for enhancement output, and/or some otherapplication may be given the data and interpret the data according tothe protocol standards. Such an application may extract the payload,receive input of the time and cause the payload to be played when thetime equals the indicated time in the packet. The payload may be playedat a speed so that it takes an indicated and/or otherwise agreed uponlength of time to play the payload. The application may control thephone to play the payload in accordance with any other descriptors(e.g., by adjusting volume, by controlling an indicated speaker, and soon).

In some embodiments, a time used to determine a start time on a phonemay be a local time set on the phone. In some embodiments, because timesmay be off from phone to phone, a time set locally on a phone may not bea trusted source. Some embodiments may sync a time with a trusted timesource prior to playing an output (e.g., sync to a GPS time). Someembodiments may determine if a time is synced to a trusted source priorto beginning and may use the local time if it is synced. Someembodiments may use a trusted time source such as a GPS time always orif the local time is not synced with the trusted source.

A plurality of such packets (e.g., one for each portion of apresentation) may be sent from a source (e.g., a server, a data source).All of part of that stream may be received by a output device (e.g., asmartphone). Each received packet may be acted upon to create a unifiedoutput in accordance with the descriptors to coincide with anotherpresentation (e.g., a video presentation on a billboard). A missedpacket may be ignored leaving a gap in the presentation. Anacknowledgement protocol may be used so that missed packets may beresent. In some embodiments, if a packet is received after its stat timeit may be ignored. In some embodiments, if a packet is received afterits start time and after it should have been finished playing (e.g., atime equal to or later than its start time plus its length of timefield) it may be ignored. In some embodiments, if a packet is receivedafter its start time but before it was to have finished playing it maybe processed and the portion of the payload that is still to be playedmay be played. For example, if a packet is received at 1 pm and 5 msthat has a 1 pm start time and a 10 ms length, then it may be processedand a second half of the audio data may be played to fill the time from1 pm and 5 ms to 1 pm and 10 ms.

It should be recognized that the example protocol and data packet ofFIG. 4 and the accompanying discussion presents non-limiting examplesonly. For example, although the discussion has been given in terms of anaudio presentation it should be recognized that the data in the payloadmay take any form (e.g., video, haptic, scent, taste, etc.). It shouldalso be recognized that header or descriptors may be arranged to matchthat data type (e.g., brightness for video, intensity for haptic, and soon).

It should also be recognized that while the example is given in terms ofone type of data being transmitted to an enhancement device, that suchdescription is also non-limiting. For example, in some embodiment'smultiple types of outputs may be desired in an enhancement device (e.g.,audio and haptic). Accordingly, multiple types of data either in asingle or multiple streams may be transmitted to that device. As anotherexample, different streams of different types of data according to sucha protocol may be sent to different enhancement device so that theiroutputs are coordinated (e.g., audio stream to a smartphone and hapticstream to a smart watch). As yet another example, a stream according tosuch a protocol may be sent to a primary output device (e.g., a digitalbillboard, a content player) so that the primary output is controlledsimilarly to the enhancement device to make a coordinated presentation.

Such data packet use may help reduce latency issues both betweenenhancement devices and between an enhancement device and a primaryoutput device by coordinating the time of presentations at each device(e.g., to a trusted time source).

It should be recognized that the various examples of syncing techniquesare given as non-limiting examples only. Various techniques describedherein or elsewhere may be combined and/or used in any manner asdesired. For example, in some embodiments, a calibration output soundand/or ongoing calibration may be played and recorded using a microphoneto determine a devices self-latency. An output of a data packet streamaccording to the protocol of FIG. 4 may be adjusted to account for thatdevice latency (e.g., if a 0.01 ms latency is introduced by the devicewhen a test tone that may or may not be human perceptible is played,then start times of received packets may be adjusted by subtracting 0.01ms from them).

Broadcast Interactions

Some embodiments may include providing an auxiliary output to a remoteprimary output, to a series of primary outputs, and/or to a primateprimary output. For example, a television or other entertainment systemmay present video to one or more people and an auxiliary device such asa smartphone may be used to present audio to coincide with that videopresentation.

FIG. 5 shows an example of this in an airport gate where the televisionacts as a primary source to provide video and the smartphone acts as anauxiliary device to provide audio. Airport gates may be loud and accessto a listening location for a television may be difficult to come by.Extending the audio of the television through a smartphone may allowmore individuals to fully enjoy the entertainment presented by thetelevision. Moreover, multiple televisions may be arranged to presentdifferent video outputs (e.g., different channels). A smartphone mayselect one form that set to listen to. Accordingly by extending theaudio through a smartphone, a user is given an expanded universe ofentertainment options.

FIG. 6 shows an example of this in an airplane where a seat backentertainment system acts as a primary device to present video and asmartphone acts as an auxiliary device to present audio. By extendingaudio through a smartphone, a provider of entertainment may gatherinformation about the user that might otherwise not be gathered.Moreover, a passenger may be able to continue listening to anentertainment show while not seated (e.g., when moving about the cabinof a plane).

A similar interaction may occur, for example, in a fitness facility(e.g., a user may be presented with multiple televisions and choose oneto listen to while working out), in a sports bar (e.g., in a loudenvironment with multiple sports being shown on multiple televisions, auser may select one television to listen to and for example may place asmart phone on speaker so that a table of people may listen to thattelevision), in a sports venue such as a racetrack, stadium or arena(e.g., where audio from a video display such as one that providespregame entertainment may be streamed to a smartphone), in any transitstop (e.g., similar to the airport example), on college campuses, inresorts, in any public space, and/or in any other desired context.

In some embodiments, interaction with a primary display and anaugmenting audio source in such an environment may be similar to theexamples described elsewhere herein. A system may control and directaudio and/or video data locally and/or remotely. In some embodiments, adelay may be added to synchronize the audio and video. For example, if alive television broadcast is incoming to a gym or other environment, thetelevision broadcast may be processed to obtain the audio from thetransmission. The video may be routed to the television (audio as wellin some embodiments). The audio may be processed and rerouted tolistening smartphones. Processing of the audio may introduce latencydifferently than the video so that the audio and video may be out ofsync. To account for that latency, a delay of the video may beintentionally introduced.

Some embodiments may include a computing device (e.g., a general purposedevice programmed to do a specific purpose, a standalone deviceconfigured to perform a specific purpose) that may receive input (e.g.,from a cable or satellite or antenna input) of a broadcast or otherentertainment source (e.g., dvd, etc.). The device may process the inputand output it to one or more display and augmenting devices.

FIG. 7 illustrates one example of such a device that may be included insome embodiments. The device may accept a set of inputs 701 (1 to anynumber) of video and audio. The device may stream the audio through awireless network though antenna 703. In some embodiments, the device mayconnect in a wired or wireless fashion to a router of a network and actas a network resource to stream to device connected to the networkthrough the router. The device may process the input and direct thevideo data to televisions 705. The device may direct the audio tolistening smartphones on the network. If desired, the device mayintroduce a delay into the video and/or audio stream so that the streamsremain in sync.

Such a device may be purchased by a gym or other venue and plugged in toprovide augmentation serves through smartphones to customers.

A user may access a website hosted by such a device and accessible tolocal smartphones. The website may present a selection of audio streamsthat are available for streaming to the smartphones. Streams may belabeled to match labels on televisions. A user may access the website toenable streaming of a desired channel.

In some embodiments, a QR code and/or NFC transmitter may be placed inan environment to provide information that may enable a smartphone toaccess the website and/or a specific audio stream. For example, a personat a sports bar may scan a QR code on a menu to choose which of tentelevisions to listen to. The smartphone may be directed to access anetwork resource to play the selected audio stream.

In some embodiments, a smartphone may execute an application thatenables audio streaming to match video sources in this context. Anapplication may scan a local network for audio stream resources. A listof available resources may be presented through an interface of theapplication so that a user may select which resource to listen to. Theapplication may connect to the selected resource and stream that audio.Resources may be labeled to coincide with television labels.

It should be recognized that the examples of broadcast interactions areand that of FIG. 7 are given as non-limiting examples only. In someembodiments, for example, the audio data may not be local to a network,but rather may be accessed through a remote internet source. A datasource on the internet may provide streams of various channels' audioand the user may access an appropriate stream through the internetrather than through a local network.

Moreover, while examples are given in terms of audio and video withaudio being streamed to a smartphone and video being presented through atelevision, that such examples are non-limiting. Any set of device usingany type of input and output may be used. For example, in someembodiments, an audio presenting may be made in a nightclub and a usermay select which of a plurality of available video streams that coincideto the audio presentation to view. The video streams, for example, mayshow different music video versions that accompany a song being played.

Location Affinity

In some embodiments, a location of an enhancement device may influence apresentation of output through the device. For example, in someembodiments, a device may be prohibited and/or enable to make an outputbased on its location. As another example, an output may be adjustedbased on a location of a device.

A server, for example, may determine a location of a device. Forexample, a server may receive a self-reported location from the device.A smartphone for example may have access to GPS coordinates and reportthose coordinates to the server. As another example, a server may applyan IP location technique to determine a location of a device based onthe IP address of the device. Such a service may be provided throughLocAid, for example. Various other location determination techniques maybe used such as geofencing, triangulation, and so on. Any informationabout a phone, other device and/or user may be used to generate alocation query that could determine the location of the phone. In someembodiments, the server may determine the location in response to arequest to access an audio stream. Location information may bedetermined to any level of desired specificity.

In some embodiments, if a location is in an approved area, audio datamay be sent to the device. In some embodiments, if a location is not inan approved area, audio data may be prevent from being sent to thedevice. For example, in some embodiments, users may be required to be atHarmon Corner in order to receive audio data coinciding with a videopresentation on the Harmon Corner billboard. A GPS coordinate of asmartphone reported by the phone to the server through an applicationrunning on the phone may be compared to a location of the Harmon Corner.If the GPS location is within a defined distance (e.g., 100 yards, 10feet, 100 feet, 1 mile, 10 miles, etc.), a user may be permitted toreceive audio data. By limiting presentation in such a manner, apresentation may become an event that draws a crowd to a particularlocation.

As another example, access to audio may be limited to particularnetworks. A network may act as a proxy for location For example, in theKanye West paradigm, a Wi-Fi network may be established near each of theareas where a presentation is being made. People that connect to thatany of those networks may be allowed to stream audio that corresponds tothe presentation. Those devices that attempt to stream the audio fromother networks may be prevented from doing so.

In some embodiments, a location may influence how a presentation ismade.

For example, users on one side of Harmon Corner may be presented withdifferent audio than users on another side of Harmon Corner. A servermay determine a location of a user/device in any manner, and based onthat location determine what audio to present to the user in accordancewith a plan for a presentation. A controller, for example, may identifythat a left channel of audio should be sent to users on one side of astreet and a right channel of audio should be sent to users on anotherside of the street. In response to determining the location of a devicea server may transmit an appropriate piece of audio data in accordancewith such a plan. In this example, a stereophonic effect may begenerated for listeners in a middle of a street (e.g., if users on eachside enable a speaker phone with sufficient volume).

In some embodiments, a server may monitor location changes and adjust apresentation accordingly For example, if a user moves from one side ofthe road to another side of the road during a presentation, the audiobeing transmitted to the user's device may change accordingly. In someembodiments, a location may be set at a start of a presentation and notupdated later.

Examples of stereophonic sound effects are given as a non-limitingexample only. In some embodiments any number of different audiopresentations may be made in any manner. For example, a differentlytimed presentation may be given at a plurality of different locations, acompletely different presentation may be given in response todetermining different locations, and so on.

Although examples in this section discussing different audiopresentations being given based on location, it should be recognizedthat basing such differences on location is a non-limiting example. Someembodiments may use any desired characteristic to determine an audiopresentation to be made instead of and/or in addition to location. Forexample, model of phone, features of a phone, demographic of a user,area code of a phone number, direction of movement of device, directiona device is facing, and so on may be used to determine which of aplurality of audio data to present to a user and/or characteristics ofthat audio data. Still other embodiments may make a random decisionregarding which of a plurality of audio data to present to a user and/orcharacteristics of that audio data. It should be recognized thatexamples given herein regarding use of locations and so on are given asnon-limiting examples only and that such example may be combined in anyway with any other embodiments.

Other Device Examples

Various examples have been given in terms of a smartphone proving anenhancement to display device. Those examples are given as non-limitingexamples only. Any combination of devices may be used together to createa unified presentation as desired.

For example, in some embodiments, a smartcar (e.g., a car with a largeamount of computer technology, a phone is to smart phone as a car is toa smartcar, a car with internet access, a car that can run applicationson an onboard computer, a car such as the Tesla Model S that has anonboard computer that is scheduled to begin receiving apps in mid-2014)may be used to present audio to a user (e.g., a passenger in the car).An augmented reality glasses device (e.g., a device such as the GoogleGlass device) may be used to present visual information that coincideswith the audio presentation. A device such as that of FIG. 7 may be partof the smartcar and allow for the streaming and processing of input toenable the presentation of such coordinated outputs across multipledevices in and/or proximate to the smartcar.

In another embodiment, a smartcar driving down a road may present audioto a user that coincides with a billboard display along the road. Forexample, based on a location, direction of travel, and/or speed of asmartcar determined by a server that the smartcar communicates with, thesmartcar may be configured to make an audio presentation thatcorresponds to billboard content that is being passed by the smartcar.

In still another example, a smartphone may make an audio presentation toa user. A smartwatch (e.g., a watch that may run applications, a watchsuch as the Sony

Smartwatch or the rumored Apple smartwatch) may make a coordinatedhaptic output to a user. And, a plurality of display devices that a userpasses may make a coordinated visual presentation to the user. A servermay control the smartwatch to make the haptic output in concert with theaudio output. The server may determine the user's location and controlnearby display devices to make a coordinated output to match the audiopresentation as well.

For example, the server may have access to a mapping of display devicesnear the user may choose to cause displays that are within a particulardistance of the user to make a coordinated output. As the user moves,those displays may change to match the user's location.

Once again it should be recognized that these example are given asnon-limiting examples only that illustrate the vast diversity andpotential in the various embodiments.

Data and Interactions

Some embodiments may include providing services through an enhancementdevice and/or collecting information about a user. For example,information about a user may be tracked, stored, collected, etc. forexample, for marketing purposes. As another example, a device may beused to obtain information, engage in transactions, and so on that mayrelate to a presentation.

For example, in some embodiments, information may be requested from auser and/or a device to enable an enhancement of a presentation. Suchinformation may include a name, an address, a phone number, an emailaddress, demographic information, interest, and so on. A user mayvoluntarily enter that information through an interface (e.g., awebpage, an application interface) and/or such information may bequeried from a smartphone by a server.

A user may be tracked based on that information. For example, a user'sphone number (or other phone ID such as a MAC address, UUID, etc.) maybe recorded in a database for each time the user accesses anenhancement. The user's preferences may be determined based on thattracking. For example, a user may be determined to be a Kanye West fanin response to a user participating in a Kanye West promotion through asmartphone and determined to be a Chicago Bears fan based on the userselecting to listen to one or more Chicago Bears games in a sports barsetting. Tracked information may be sold and/or licensed to advertisersallowing more directed advertising and/or used to determine userinterest in future presentations.

In some embodiments, an interface provided to a user may allow the userto access additional features. For example, a user listening to an audiostream for a presentation through a smartphone may be enabled to takeadditional actions through the smartphone (e.g., actions that may onlybe available to users that are listening to the audio presentationand/or accessing an application or webpage for accessing the audiopresentation). Such actions may include, for example, purchasing ofitems (e.g., tickets to a show, music, food, VIP access, etc.), downloaditems (e.g., music tracks, ringtone, background images, etc.), viewingvideos (e.g., replays of events, different perspectives of an event fromthat being shown on a display device, etc.), viewing information (e.g.,statistics of a sports event, biography information, etc.), playinggames (e.g., trivia games with other players, enter into contests, playa demo of a game being launched, etc.), engaging in social mediainteractions (e.g., make posts to Facebook and/or Twitter, etc.), and/orperforming any other desired actions. In some embodiments, advertisingand/or branding information may be displayed through a smartphone whilea user is listening to an audio output. In some embodiments, suchadvertising may be related to the content and/or based on previouslyobserved preferences of a user.

In some embodiments, data about a user's responses may be recorded,transmitted, tracked, monitored, and so on. For example, a reaction to apresentation may be monitored and reported to a server for use asmarketing data. A reaction, for example, may include a biometricreaction recorded by a smartwatch and/or smartcar (e.g., change intemperature, change in movement rate, change in heart rate, etc.). Areaction may include a picture or video taken of a user through a frontfacing camera of a smart phone. Any information about a user may bemonitored and used to determine a user's response to a presentation.That response may be indicative of a user's interest level in apromotion and may be used to further target advertising and/or otherpresentations to the user.

It should be recognized that various examples of actions that may beperformed by users and/or monitoring of users are given as non-limitingexamples only. Various embodiments may include some, all, none,different, and so on actions and/or monitoring features as desired.

Daredevil Across Times Square

In some embodiments, a live event may be presented in an environmentthrough one or more display device proximate to the environment. Thepresentation may be made in coordination with enhancement presentationsmade through one or more enhancement devices proximate to theenvironment. As an example that illustrates some of the versatility thatmay be possible in some embodiments, a daredevil may plan a hire wiredrive across a canyon that may be presented. FIG. 8 illustrates anexample method that may be performed to present such an event.

In such an example, cameras may be placed along the high wire to capturethe daredevil's fete. Billboards throughout Times Square may be used topresent the daredevil's ride across the canyon. Camera placement may beconfigured to mimic the placement of billboards around Times Square.Each camera's input may be directed to a corresponding billboard inTimes Square so that the visual appearance in Times Square is as if thebike is making the ride through the square.

As indicated at 801, a data source such as that shown in Figure la orother device may receive input from the cameras. The data source orother device may direct the appropriate billboards to display therespective visual data as the biker makes his or her ride across thecanyon. As indicated at 803, the data source may process the video anddirect the processed video to respective billboards. The data source orother device may delay the presentation to the billboards to provide forcaching or other syncing functionalities. The data source may encode thedata to a format that enables proper syncing.

As indicated at 805, the data source or other device may determine audiodata to be presented through smartphones for presentation incoordination with the video. The audio data may be actual data capturedby a camera and/or simulated bike roaring sent to the data source from acontroller of the presentation (e.g., a person, a program). A datasource may send that information to a server for presentation to users.As indicated at 807, a server or other device may determine locations ofusers watching the presentation and present the audio data to the usersbased on that location. For example, as the biker moves from one side ofthe canyon and correspondingly Times Square, sound may be output of abike engine roar that follows the biker across the way. As the biker isshown to move across the square on the displays that span the square sotoo may sound of the biker travel through the smartphones devices thatcommunicate with the server move across the square.

As indicated at 809, the data source or other device may determinehaptic data for presentation in coordination with the video and audio.The haptic data may be recorded by a camera and/or seismic device. Thedata may be simulated by a controller of a presentation. The data may bedetermined to match sound data and/or video data. A data source may sendthat data to a server for presentation to users. As indicated at 811, aserver or other device may determine locations of users and presenthaptic output to users based on the locations. For example, as a bikermoves from one side of the canyon and correspondingly Times

Square, a vibration of a smartphone or smartwatch may follow the bikeracross the way. As users move closer to a display when the biker isshown close to a corresponding camera, the vibration may increase (e.g.,in speed and/or intensity). As the biker is shown and heard to moveacross the square, the feeling of the engine's vibrations may be felt toalso move across the square through smartphones and/or smartwatchescommunicating with the sever. Audio and haptic output may be through asame or different device, When a location determine is referenced, thatlocation may be determined once (e.g., for single smartphone and usedfor both haptic and audio), and/or determined separately for each evenif one or multiple devices are used. Audio and haptic output may berequired to be presented together and/or may be presented individuallyas desired.

The biker may wear a 360 degree camera assembly on his or her helmet (orotherwise any number of cameras on any element associated with thecrossing of the canyon such as an assembly that hangs below the biker orabove the biker). As indicated at 813, input from that camera assemblymay be received (e.g., by the data source), processed and sent to aserver for possible presentation. A user using a smartphone may gainaccess to that visual data. For example, a user may hold a smartphonefacing a direction and be shown visual data from the 360 degree cameramount that is facing in that direction. This may allow a user tosimulate being the biker and looking around the canyon as the canyon iscrossed. As indicated at 815, a server may determine a direction thatthe smartphone is facing and based on that direction may transmit avideo feed from an appropriate input of the 360 degree camera mount tobe presented to the smartphone. As the user moves the smart phone toface different directions, the video feed sent to the phone may beadjusted to match the new direction.

It should be recognized that this example is given as a non-limitingexample only. This example illustrates some of the versatility andpossibilities that may be possible in various embodiments. Otherembodiment my include any of a variety of functionality and combinationsof elements as desired.

Various non-limiting examples and/or embodiments have been described.Other embodiments may include some, none, all, different, similar, andso on features. Embodiments and/or examples may be combined in anymanner. For example, a feature in one section of this application may becombined with one or more feature form another embodiment described inthe application in any order or manner. No particular element orfeatures is required in any embodiment. It should also be understoodthat while examples of some embodiments are given in terms of a singleuser observing a presentation, that embodiments may include any numberof observers observing a presentation. The observers may be treatedsimilarly and/or differently. For example, a thousand users may view ofa presentation at Harmon Corner and each obtain audio output through arespective smartphone (e.g., using a method similar to that of FIG. 2).

The following sections provide a guide to interpreting the presentapplication.

II. Terms

The term “product” means any machine, manufacture and/or composition ofmatter, unless expressly specified otherwise.

The term “process” means any process, algorithm, method or the like,unless expressly specified otherwise.

Each process (whether called a method, algorithm or otherwise)inherently includes one or more steps, and therefore all references to a“step” or “steps” of a process have an inherent antecedent basis in themere recitation of the term ‘process’ or a like term.

Accordingly, any reference in a claim to a ‘step’ or ‘steps’ of aprocess has sufficient antecedent basis.

The term “invention” and the like mean “the one or more inventionsdisclosed in this application”, unless expressly specified otherwise.

The terms “an embodiment”, “embodiment”, “embodiments”, “theembodiment”, “the embodiments”, “one or more embodiments”, “someembodiments”, “certain embodiments”, “one embodiment”, “anotherembodiment” and the like mean “one or more (but not all) embodiments ofthe disclosed invention(s)”, unless expressly specified otherwise.

The term “variation” of an invention means an embodiment of theinvention, unless expressly specified otherwise.

A reference to “another embodiment” in describing an embodiment does notimply that the referenced embodiment is mutually exclusive with anotherembodiment (e.g., an embodiment described before the referencedembodiment), unless expressly specified otherwise.

The terms “including”, “comprising” and variations thereof mean“including but not necessarily limited to”, unless expressly specifiedotherwise. Thus, for example, the sentence “the portfolio includes a redwidget and a blue widget” means the portfolio includes the red widgetand the blue widget, but may include something else.

The term “consisting of” and variations thereof means “including andlimited to”, unless expressly specified otherwise. Thus, for example,the sentence “the portfolio consists of a red widget and a blue widget”means the portfolio includes the red widget and the blue widget, butdoes not include anything else.

The term “compose” and variations thereof means “to make up theconstituent parts of, component of or member of”, unless expresslyspecified otherwise. Thus, for example, the sentence “the red widget andthe blue widget compose a portfolio” means the portfolio includes thered widget and the blue widget.

The term “exclusively compose” and variations thereof means “to make upexclusively the constituent parts of, to be the only components of or tobe the only members of”, unless expressly specified otherwise. Thus, forexample, the sentence “the red widget and the blue widget exclusivelycompose a portfolio” means the portfolio consists of the red widget andthe blue widget, and nothing else.

The terms “a”, “an” and “the” mean “one or more”, unless expresslyspecified otherwise.

The term “plurality” means “two or more”, unless expressly specifiedotherwise.

The term “herein” means “in the present application, including anythingwhich may be incorporated by reference”, unless expressly specifiedotherwise.

The phrase “at least one of”, when such phrase modifies a plurality ofthings (such as an enumerated list of things) means any combination ofone or more of those things, unless expressly specified otherwise. Forexample, the phrase “at least one of a widget, a car and a wheel” meanseither (i) a widget, (ii) a car, (iii) a wheel, (iv) a widget and a car,(v) a widget and a wheel, (vi) a car and a wheel, or (vii) a widget, acar and a wheel. The phrase “at least one of”, when such phrase modifiesa plurality of things does not mean “one of each of” the plurality ofthings.

Numerical terms such as “one”, “two”, etc. when used as cardinal numbersto indicate quantity of something (e.g., one widget, two widgets), meanthe quantity indicated by that numerical term, but do not mean at leastthe quantity indicated by that numerical term. For example, the phrase“one widget” does not mean “at least one widget”, and therefore thephrase “one widget” does not cover, e.g., two widgets.

The phrase “based on” does not mean “based only on”, unless expresslyspecified otherwise. In other words, the phrase “based on” describesboth “based only on” and “based at least on”. The phrase “based at leaston” is equivalent to the phrase “based at least in part on”.

The term “represent” and like terms are not exclusive, unless expresslyspecified otherwise. For example, the term “represents” does not mean“represents only”, unless expressly specified otherwise. In other words,the phrase “the data represents a credit card number” describes both“the data represents only a credit card number” and “the data representsa credit card number and the data also represents something else”.

The term “whereby” is used herein only to precede a clause or other setof words that express only the intended result, objective or consequenceof something that is previously and explicitly recited. Thus, when theterm “whereby” is used in a claim, the clause or other words that theterm “whereby” modifies do not establish specific further limitations ofthe claim or otherwise restricts the meaning or scope of the claim.

The term “e.g.” and like terms mean “for example”, and thus does notlimit the term or phrase it explains. For example, in the sentence “thecomputer sends data (e.g., instructions, a data structure) over theInternet”, the term “e.g.” explains that “instructions” are an exampleof “data” that the computer may send over the Internet, and alsoexplains that “a data structure” is an example of “data” that thecomputer may send over the Internet. However, both “instructions” and “adata structure” are merely examples of “data”, and other things besides“instructions” and “a data structure” can be “data”.

The term “respective” and like terms mean “taken individually”. Thus iftwo or more things have “respective” characteristics, then each suchthing has its own characteristic, and these characteristics can bedifferent from each other but need not be. For example, the phrase “eachof two machines has a respective function” means that the first suchmachine has a function and the second such machine has a function aswell. The function of the first machine may or may not be the same asthe function of the second machine.

The term “i.e.” and like terms mean “that is”, and thus limits the termor phrase it explains. For example, in the sentence “the computer sendsdata (i.e., instructions) over the Internet”, the term “i.e.” explainsthat “instructions” are the “data” that the computer sends over theInternet.

Any given numerical range shall include whole and fractions of numberswithin the range. For example, the range “1 to 10” shall be interpretedto specifically include whole numbers between 1 and 10 (e.g., 1, 2, 3,4, . . . 9) and non-whole numbers (e.g., 1.1, 1.2, . . . 1.9).

Where two or more terms or phrases are synonymous (e.g., because of anexplicit statement that the terms or phrases are synonymous), instancesof one such term/phrase does not mean instances of another suchterm/phrase must have a different meaning. For example, where astatement renders the meaning of “including” to be synonymous with“including but not limited to”, the mere usage of the phrase “includingbut not limited to” does not mean that the term “including” meanssomething other than “including but not limited to”.

III. Determining

The term “determining” and grammatical variants thereof (e.g., todetermine a price, determining a value, determine an object which meetsa certain criterion) is used in an extremely broad sense. The term“determining” encompasses a wide variety of actions and therefore“determining” can include calculating, computing, processing, deriving,investigating, looking up (e.g., looking up in a table, a database oranother data structure), ascertaining and the like. Also, “determining”can include receiving (e.g., receiving information), accessing (e.g.,accessing data in a memory) and the like. Also, “determining” caninclude resolving, selecting, choosing, establishing, and the like.

The term “determining” does not imply certainty or absolute precision,and therefore “determining” can include estimating, extrapolating,predicting, guessing and the like.

The term “determining” does not imply that mathematical processing mustbe performed, and does not imply that numerical methods must be used,and does not imply that an algorithm or process is used.

The term “determining” does not imply that any particular device must beused. For example, a computer need not necessarily perform thedetermining.

IV. Forms of Sentences

Where a limitation of a first claim would cover one of a feature as wellas more than one of a feature (e.g., a limitation such as “at least onewidget” covers one widget as well as more than one widget), and where ina second claim that depends on the first claim, the second claim uses adefinite article “the” to refer to the limitation (e.g., “the widget”),this does not imply that the first claim covers only one of the feature,and this does not imply that the second claim covers only one of thefeature (e.g., “the widget” can cover both one widget and more than onewidget).

When an ordinal number (such as “first”, “second”, “third” and so on) isused as an adjective before a term, that ordinal number is used (unlessexpressly specified otherwise) merely to indicate a particular feature,such as to distinguish that particular feature from another feature thatis described by the same term or by a similar term. For example, a“first widget” may be so named merely to distinguish it from, e.g., a“second widget”. Thus, the mere usage of the ordinal numbers “first” and“second” before the term “widget” does not indicate any otherrelationship between the two widgets, and likewise does not indicate anyother characteristics of either or both widgets. For example, the mereusage of the ordinal numbers “first” and “second” before the term“widget” (1) does not indicate that either widget comes before or afterany other in order or location; (2) does not indicate that either widgetoccurs or acts before or after any other in time; and (3) does notindicate that either widget ranks above or below any other, as inimportance or quality. In addition, the mere usage of ordinal numbersdoes not define a numerical limit to the features identified with theordinal numbers. For example, the mere usage of the ordinal numbers“first” and “second” before the term “widget” does not indicate thatthere must be no more than two widgets.

When a single device, article or other product is described herein, morethan one device/article (whether or not they cooperate) mayalternatively be used in place of the single device/article that isdescribed. Accordingly, the functionality that is described as beingpossessed by a device may alternatively be possessed by more than onedevice/article (whether or not they cooperate).

Similarly, where more than one device, article or other product isdescribed herein (whether or not they cooperate), a singledevice/article may alternatively be used in place of the more than onedevice or article that is described. For example, a plurality ofcomputer-based devices may be substituted with a single computer-baseddevice. Accordingly, the various functionality that is described asbeing possessed by more than one device or article may alternatively bepossessed by a single device/article.

The functionality and/or the features of a single device that isdescribed may be alternatively embodied by one or more other deviceswhich are described but are not explicitly described as having suchfunctionality/features. Thus, other embodiments need not include thedescribed device itself, but rather can include the one or more otherdevices which would, in those other embodiments, have suchfunctionality/features.

V. Disclosed Examples and Terminology Are Not Limiting

Neither the Title (set forth at the beginning of the first page of thepresent application) nor the Abstract (set forth at the end of thepresent application) is to be taken as limiting in any way as the scopeof the disclosed invention(s), is to be used in interpreting the meaningof any claim or is to be used in limiting the scope of any claim.. AnAbstract has been included in this application merely because anAbstract is required under 37 C.F.R. §1.72(b).

The title of the present application and headings of sections providedin the present application are for convenience only, and are not to betaken as limiting the disclosure in any way.

Numerous embodiments are described in the present application, and arepresented for illustrative purposes only. The described embodiments arenot, and are not intended to be, limiting in any sense. The presentlydisclosed invention(s) are widely applicable to numerous embodiments, asis readily apparent from the disclosure. One of ordinary skill in theart will recognize that the disclosed invention(s) may be practiced withvarious modifications and alterations, such as structural, logical,software, and electrical modifications. Although particular features ofthe disclosed invention(s) may be described with reference to one ormore particular embodiments and/or drawings, it should be understoodthat such features are not limited to usage in the one or moreparticular embodiments or drawings with reference to which they aredescribed, unless expressly specified otherwise.

Though an embodiment may be disclosed as including several features,other embodiments of the invention may include fewer than all suchfeatures. Thus, for example, a claim may be directed to less than theentire set of features in a disclosed embodiment, and such claim wouldnot include features beyond those features that the claim expresslyrecites.

No embodiment of method steps or product elements described in thepresent application constitutes the invention claimed herein, or isessential to the invention claimed herein, or is coextensive with theinvention claimed herein, except where it is either expressly stated tobe so in this specification or expressly recited in a claim.

The preambles of the claims that follow recite purposes, benefits andpossible uses of the claimed invention only and do not limit the claimedinvention.

The present disclosure is not a literal description of all embodimentsof the invention(s). Also, the present disclosure is not a listing offeatures of the invention(s) which must be present in all embodiments.

All disclosed embodiment are not necessarily covered by the claims (evenincluding all pending, amended, issued and canceled claims). Inaddition, an embodiment may be (but need not necessarily be) covered byseveral claims. Accordingly, where a claim (regardless of whetherpending, amended, issued or canceled) is directed to a particularembodiment, such is not evidence that the scope of other claims do notalso cover that embodiment.

Devices that are described as in communication with each other need notbe in continuous communication with each other, unless expresslyspecified otherwise. On the contrary, such devices need only transmit toeach other as necessary or desirable, and may actually refrain fromexchanging data most of the time. For example, a machine incommunication with another machine via the Internet may not transmitdata to the other machine for long period of time (e.g. weeks at atime). In addition, devices that are in communication with each othermay communicate directly or indirectly through one or moreintermediaries.

A description of an embodiment with several components or features doesnot imply that all or even any of such components/features are required.On the contrary, a variety of optional components are described toillustrate the wide variety of possible embodiments of the presentinvention(s). Unless otherwise specified explicitly, nocomponent/feature is essential or required.

Although process steps, algorithms or the like may be described orclaimed in a particular sequential order, such processes may beconfigured to work in different orders. In other words, any sequence ororder of steps that may be explicitly described or claimed does notnecessarily indicate a requirement that the steps be performed in thatorder. The steps of processes described herein may be performed in anyorder possible. Further, some steps may be performed simultaneouslydespite being described or implied as occurring non-simultaneously(e.g., because one step is described after the other step). Moreover,the illustration of a process by its depiction in a drawing does notimply that the illustrated process is exclusive of other variations andmodifications thereto, does not imply that the illustrated process orany of its steps are necessary to the invention(s), and does not implythat the illustrated process is preferred.

Although a process may be described as including a plurality of steps,that does not imply that all or any of the steps are preferred,essential or required. Various other embodiments within the scope of thedescribed invention(s) include other processes that omit some or all ofthe described steps. Unless otherwise specified explicitly, no step isessential or required.

Although a process may be described singly or without reference to otherproducts or methods, in an embodiment the process may interact withother products or methods. For example, such interaction may includelinking one business model to another business model. Such interactionmay be provided to enhance the flexibility or desirability of theprocess.

Although a product may be described as including a plurality ofcomponents, aspects, qualities, characteristics and/or features, thatdoes not indicate that any or all of the plurality are preferred,essential or required. Various other embodiments within the scope of thedescribed invention(s) include other products that omit some or all ofthe described plurality.

An enumerated list of items (which may or may not be numbered) does notimply that any or all of the items are mutually exclusive, unlessexpressly specified otherwise. Likewise, an enumerated list of items(which may or may not be numbered) does not imply that any or all of theitems are comprehensive of any category, unless expressly specifiedotherwise. For example, the enumerated list “a computer, a laptop, aPDA” does not imply that any or all of the three items of that list aremutually exclusive and does not imply that any or all of the three itemsof that list are comprehensive of any category.

An enumerated list of items (which may or may not be numbered) does notimply that any or all of the items are equivalent to each other orreadily substituted for each other.

All embodiments are illustrative, and do not imply that the invention orany embodiments were made or performed, as the case may be.

VI. Computing

It will be readily apparent to one of ordinary skill in the art that thevarious processes described herein may be implemented by, e.g.,appropriately programmed general purpose computers, special purposecomputers and computing devices. Typically a processor (e.g., one ormore microprocessors, one or more microcontrollers, one or more digitalsignal processors) will receive instructions (e.g., from a memory orlike device), and execute those instructions, thereby performing one ormore processes defined by those instructions. Instructions may beembodied in, e.g., one or more computer programs, one or more scripts.

A “processor” means one or more microprocessors, central processingunits (CPUs), computing devices, microcontrollers, digital signalprocessors, or like devices or any combination thereof, regardless ofthe architecture (e.g., chip-level multiprocessing/multi-core, RISC,CISC, Microprocessor without Interlocked Pipeline Stages, pipeliningconfiguration, simultaneous multithreading).

Thus a description of a process is likewise a description of anapparatus for performing the process. The apparatus that performs theprocess can include, e.g., a processor and those input devices andoutput devices that are appropriate to perform the process.

Further, programs that implement such methods (as well as other types ofdata) may be stored and transmitted using a variety of media (e.g.,computer readable media) in a number of manners. In some embodiments,hard-wired circuitry or custom hardware may be used in place of, or incombination with, some or all of the software instructions that canimplement the processes of various embodiments. Thus, variouscombinations of hardware and software may be used instead of softwareonly.

The term “computer-readable medium” refers to any medium, a plurality ofthe same, or a combination of different media, that participate inproviding data (e.g., instructions, data structures) which may be readby a computer, a processor or a like device. Such a medium may take manyforms, including but not limited to, non-volatile media, volatile media,and transmission media. Non-volatile media include, for example, opticalor magnetic disks and other persistent memory. Volatile media includedynamic random access memory (DRAM), which typically constitutes themain memory. Transmission media include coaxial cables, copper wire andfiber optics, including the wires that comprise a system bus coupled tothe processor. Transmission media may include or convey acoustic waves,light waves and electromagnetic emissions, such as those generatedduring radio frequency (RF) and infrared (IR) data communications.Common forms of computer-readable media include, for example, a floppydisk, a flexible disk, hard disk, magnetic tape, any other magneticmedium, a CD-ROM, DVD, any other optical medium, punch cards, papertape, any other physical medium with patterns of holes, a RAM, a PROM,an EPROM, a FLASH-EEPROM, any other memory chip or cartridge, a carrierwave as described hereinafter, or any other medium from which a computercan read.

Various forms of computer readable media may be involved in carryingdata (e.g. sequences of instructions) to a processor. For example, datamay be (i) delivered from RAM to a processor; (ii) carried over awireless transmission medium; (iii) formatted and/or transmittedaccording to numerous formats, standards or protocols, such as Ethernet(or IEEE 802.3), SAP, ATP, Bluetooth®, and TCP/IP, TDMA, CDMA, and 3G;and/or (iv) encrypted to ensure privacy or prevent fraud in any of avariety of ways well known in the art.

Thus a description of a process is likewise a description of acomputer-readable medium storing a program for performing the process.The computer-readable medium can store (in any appropriate format) thoseprogram elements which are appropriate to perform the method.

Just as the description of various steps in a process does not indicatethat all the described steps are required, embodiments of an apparatusinclude a computer/computing device operable to perform some (but notnecessarily all) of the described process.

Likewise, just as the description of various steps in a process does notindicate that all the described steps are required, embodiments of acomputer-readable medium storing a program or data structure include acomputer-readable medium storing a program that, when executed, cancause a processor to perform some (but not necessarily all) of thedescribed process.

Where databases are described, it will be understood by one of ordinaryskill in the art that (i) alternative database structures to thosedescribed may be readily employed, and (ii) other memory structuresbesides databases may be readily employed. Any illustrations ordescriptions of any sample databases presented herein are illustrativearrangements for stored representations of information. Any number ofother arrangements may be employed besides those suggested by, e.g.,tables illustrated in drawings or elsewhere. Similarly, any illustratedentries of the databases represent exemplary information only; one ofordinary skill in the art will understand that the number and content ofthe entries can be different from those described herein. Further,despite any depiction of the databases as tables, other formats(including relational databases, object-based models and/or distributeddatabases) could be used to store and manipulate the data typesdescribed herein. Likewise, object methods or behaviors of a databasecan be used to implement various processes, such as the describedherein. In addition, the databases may, in a known manner, be storedlocally or remotely from a device which accesses data in such adatabase.

Various embodiments can be configured to work in a network environmentincluding a computer that is in communication (e.g., via acommunications network) with one or more devices. The computer maycommunicate with the devices directly or indirectly, via any wired orwireless medium (e.g. the Internet, LAN, WAN or Ethernet, Token Ring, atelephone line, a cable line, a radio channel, an optical communicationsline, commercial on-line service providers, bulletin board systems, asatellite communications link, a combination of any of the above). Eachof the devices may themselves comprise computers or other computingdevices, such as those based on the Intel® Pentium® or Centrino™processor, that are adapted to communicate with the computer. Any numberand type of devices may be in communication with the computer.

In an embodiment, a server computer or centralized authority may not benecessary or desirable. For example, the present invention may, in anembodiment, be practiced on one or more devices without a centralauthority. In such an embodiment, any functions described herein asperformed by the server computer or data described as stored on theserver computer may instead be performed by or stored on one or moresuch devices.

Where a process is described, in an embodiment the process may operatewithout any user intervention. In another embodiment, the processincludes some human intervention (e.g., a step is performed by or withthe assistance of a human).

VII. Continuing Applications

The present disclosure provides, to one of ordinary skill in the art, anenabling description of several embodiments and/or inventions. Some ofthese embodiments and/or inventions may not be claimed in the presentapplication, but may nevertheless be claimed in one or more continuingapplications that claim the benefit of priority of the presentapplication.

Applicants intend to file additional applications to pursue patents forsubject matter that has been disclosed and enabled but not claimed inthe present application.

VIII. 35 U.S.C. 112, paragraph 6

In a claim, a limitation of the claim which includes the phrase “meansfor” or the phrase “step for” means that 35 U.S.C. §112, paragraph 6,applies to that limitation.

In a claim, a limitation of the claim which does not include the phrase“means for” or the phrase “step for” means that 35 U.S.C. §112,paragraph 6 does not apply to that limitation, regardless of whetherthat limitation recites a function without recitation of structure,material or acts for performing that function. For example, in a claim,the mere use of the phrase “step of” or the phrase “steps of” inreferring to one or more steps of the claim or of another claim does notmean that 35 U.S.C. §112, paragraph 6, applies to that step(s).

With respect to a means or a step for performing a specified function inaccordance with 35 U.S.C. §112, paragraph 6, the correspondingstructure, material or acts described in the specification, andequivalents thereof, may perform additional functions as well as thespecified function.

Computers, processors, computing devices and like products arestructures that can perform a wide variety of functions. Such productscan be operable to perform a specified function by executing one or moreprograms, such as a program stored in a memory device of that product orin a memory device which that product accesses. Unless expresslyspecified otherwise, such a program need not be based on any particularalgorithm, such as any particular algorithm that might be disclosed inthe present application. It is well known to one of ordinary skill inthe art that a specified function may be implemented via differentalgorithms, and any of a number of different algorithms would be a meredesign choice for carrying out the specified function.

Therefore, with respect to a means or a step for performing a specifiedfunction in accordance with 35 U.S.C. §112, paragraph 6, structurecorresponding to a specified function includes any product programmed toperform the specified function. Such structure includes programmedproducts which perform the function, regardless of whether such productis programmed with (i) a disclosed algorithm for performing thefunction, (ii) an algorithm that is similar to a disclosed algorithm, or(iii) a different algorithm for performing the function.

Where there is recited a means for performing a function that is amethod, one structure for performing this method includes a computingdevice (e.g., a general purpose computer) that is programmed and/orconfigured with appropriate hardware to perform that function.

Also included is a computing device (e.g., a general purpose computer)that is programmed and/or configured with appropriate hardware toperform that function via other algorithms as would be understood by oneof ordinary skill in the art.

IX. Disclaimer

Numerous references to a particular embodiment do not indicate adisclaimer or disavowal of additional, different embodiments, andsimilarly references to the description of embodiments which all includea particular feature do not indicate a disclaimer or disavowal ofembodiments which do not include that particular feature. A cleardisclaimer or disavowal in the present application shall be prefaced bythe phrase “does not include” or by the phrase “cannot perform”.

X. Incorporation By Reference

Any patent, patent application or other document referred to herein isincorporated by reference into this patent application as part of thepresent disclosure, but only for purposes of written description andenablement in accordance with 35 U.S.C. §112, paragraph 1, and should inno way be used to limit, define, or otherwise construe any term of thepresent application, unless without such incorporation by reference, noordinary meaning would have been ascertainable by a person of ordinaryskill in the art. Such person of ordinary skill in the art need not havebeen in any way limited by any embodiments provided in the reference

Any incorporation by reference does not, in and of itself, imply anyendorsement of, ratification of or acquiescence in any statements,opinions, arguments or characterizations contained in any incorporatedpatent, patent application or other document, unless explicitlyspecified otherwise in this patent application.

XI. Prosecution History

In interpreting the present application (which includes the claims), oneof ordinary skill in the art shall refer to the prosecution history ofthe present application, but not to the prosecution history of any otherpatent or patent application, regardless of whether there are otherpatent applications that are considered related to the presentapplication, and regardless of whether there are other patentapplications that share a claim of priority with the presentapplication.

XX. Alternative Technologies

It will be understood that the technologies described herein for making,using, or practicing various embodiments are but a subset of thepossible technologies that may be used for the same or similar purposes.The particular technologies described herein are not to be construed aslimiting. Rather, various embodiments contemplate alternate technologiesfor making, using, or practicing various embodiments.

1. An apparatus comprising: a first computing device and a firstnon-transitory medium having stored thereon instructions that whenexecuted by the first computing device cause the apparatus to: receive,through a communication network, video data for a presentation to bemade to a plurality of users; and in response to receiving the videodata, populate a publicly viewable display with the video data; a secondcomputing device configured to: determine access data for the pluralityof users to gain access to audio data for the presentation through aplurality of mobile devices of the plurality of users; and in responseto determining the access parameters, facilitate a communicationexchange that provides the access data to the plurality of mobiledevices, wherein the access data directs the mobile devices to connectto a third computing device to access the audio data; and the thirdcomputing device and a third non-transitory medium having stored thereoninstructions that when executed by the first computing device cause theapparatus to: receive, through the communication network, audio data forthe presentation to be made to the plurality of users; receive, throughthe communication network, access requests for the audio data from theplurality of mobile device; in response to receiving the accessrequests, determine a respective location of each mobile device of theplurality of mobile devices; in response to receiving the accessrequests, determine a respective audio presentation for each mobiledevice of the plurality of mobile devices based on the respectivelocation and the audio data; facilitate output of each determinedrespective audio presentation through each mobile device, in whichfacilitating output includes transmitting audio information to eachmobile device of the plurality of mobile devices, in which the audioinformation identifies a time when a portion of audio should be playedand a length of time for playing the portion of audio.
 2. The apparatusof claim 1, further comprising: a fourth computing device configured to:receiving a presentation containing the audio data and the video data;process the presentation to arrange for the audio data and the videodata to be transmitted to the first and second computing devicerespectively, in which processing the presentation data includesseparating the audio data and the video data in the presentation; andtransmit, through the communication network, the audio data to the thirdcomputing device and the video data to the first computing device. 3.The apparatus of claim 2, in which processing the presentation datainclude identifying a respective destination for each of the audio dataand the video data.
 4. The apparatus of claim 2, in which receiving thepresentation includes receiving a feed of data and providing an ongoingprocessing of the feed, in which the feed includes a live stream of data5. The apparatus of claim 2, in which processing the presentationincludes adding timing information to the audio data and schedulinginformation to the video data, in which the timing information isconfigured to synchronize the output of the audio data with the outputof the video data defined by the scheduling information.
 6. Theapparatus of claim 1, in which the communication exchange is a nearfield communication transfer of the access data
 7. The apparatus ofclaim 1, in which populating the publicly viewable display includestransmitting the video data to a content controller that controls videooutput on the publicly viewable display device.
 8. The apparatus ofclaim 1, in which the second computing device includes a plurality ofdevices that are each configured to engage in the near fieldcommunication transfer with the mobile devices.
 9. The apparatus ofclaim 1, in which the first and second computing devices are configuredto make a time synchronized output of the audio data and the video datathrough the publicly viewable display device and the plurality of mobiledevices.
 10. The apparatus of claim 1, in which the publicly viewabledisplay device is a billboard.
 11. The apparatus of claim 1, in whichthe plurality of mobile devices are smartphones.
 12. The apparatus ofclaim 1, in which the access data is a Universal Resource Locator thatidentifies the third computing device.
 13. The apparatus of claim 1, inwhich receiving the audio data includes receiving an indication of avariation in a manner of presenting the audio data based on a locationof a mobile device.